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Abstract 

This investigation seeks to establish the practicahty of numerical frame approximations. 
0^ . Specifically, it develops a new method to approximate the inverse frame operator and an- 

alyzes its convergence properties. It is established that sampling with well-localized frames 
improves both the accuracy of the numerical frame approximation as well as the robustness 
.^^ ' and efficiency of the (finite) frame operator inversion. Moreover, in applications such as 

magnetic resonance imaging, where the given data often may not constitute a well-localized 
frame, a technique is devised to project the corresponding frame data onto a more suitable 
i^H , frame. As a result, the target function may be approximated as a finite expansion with 

C^ ' its asymptotic convergence solely dependent on its smoothness. Numerical examples are 

provided. 
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tJ- ; 1 Introduction 

\q 

ff^ I Due to their flexible nature, frames make useful representation tools for a variety of applications. 

^^ ' For example, in signal processing applications, the redundancy of frames is beneficial if signals 

are suspected of not capturing certain pieces of information. Not enforcing orthogonality of 
traditional bases also is useful when small amounts of interference does not present too many 
difficulties, but working with a large (albeit orthogonal polynomial based) system does. It is also 

r> ■ possible that there are some functions that are better represented by frames than by traditional 

C^ , orthogonal bases. A nice introduction to frames in the context of some of these applications can 

be found in [151 IS] ■ 

In several applications, such as magnetic resonance imaging (MRI), data may be collected as 
a series of non- uniform Fourier coefficients (see e.g. p!|ll7 1[T8lll9j ). Since standard Fourier recon- 
struction methods cannot be straightforwardly applied, the current methodology can generally 
be described as an interpolation or approximation of the data onto Fourier integer coefficients 
which enables image reconstruction via the Fast Fourier transform (FFT) 1^ Convergence analysis 
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for several common MRI reconstruction algorithms was performed in [19], where it was shown 
that it is possible to post-process the (interpolated) integer Fourier coefficients to resolve the 
Gibbs phenomenon. However, it was also demonstrated there that the dominant reconstruction 
error was due to "resampling" the non-integer data onto integer coefficients, typically at best 
0{\/N'^) for given m = 0{N) coefficients. Since then, in [10] it was suggested that in such 
applications it might be better not to resample the non-integer coefficients, and thereby avoid 
the resampling error entirely. In fact, even for piecewise smooth functions, if the original data 
set constitutes a finite number of Fourier frame coefficients, then the Gibbs phenomenon can be 
removed directly by using the same post-processing techniques as in the uniform case. In partic- 
ular, in jlOj . the spectral reprojection method, [11], was shown to yield exponential convergence 
in this case. It was further shown there that even if the original data could not be considered 
as a finite set of coefficients of the truncated Fourier frame expansion (i.e., the corresponding 
infinite sequence did not form a Fourier frame), the same reconstruction methods could still be 
applied, although not with exponential accuracy. 

One of the main difficulties in approximating a function from its frame coefficients, indepen- 
dent of its smoothness properties, lies in the construction of the (finite) inverse frame operator. 
The frame algorithm devised in [8] and accelerated in [5l [12] is iterative and its speed greatly 
depends on the frame bounds. Other iterative methods can also be used, but inherently depend 
on what is known about the frame bounds. Furthermore, conditions that guarantee the overall 
convergence of a truncated frame expansion are not well understood. Hence the usefulness of 
numerical frame approximations is not yet well established. 

In this investigation we seek to establish the practicality of numerical frame approximations 
by developing a new approximation method for the inverse frame operator. We establish that 
sampling with well-localized frames improves both the accuracy of the numerical frame approxi- 
mation as well as the robustness and efficiency of the (finite) frame operator inversion. Moreover, 
in applications such as magnetic resonance imaging, where the given data often may not con- 
stitute a well-localized frame, a technique is devised to project the corresponding frame data 
onto a more suitable frame. As a result, the target function may be approximated as a finite 
expansion with its asymptotic convergence solely dependent on its smoothness. If the target 
function is only piecewise smooth, it is possible to apply high order post-processing methods, as 
demonstrated in [10], to remove the Gibbs phenomenon. 

The paper is organized as follows: Section [2] reviews some fundamental aspects of frame 
theory. In Section [3] we establish the convergence rate of the Casazza-Christensen method 
of approximating the inverse frame operator for well- localized frames, [H |3]. However, the 
convergence rate fails to hold when the sampling frame is not well- localized. To overcome this 
difficulty we propose a new method of approximating the inverse frame operator and prove its 
convergence rate in Section [4l In Section [5] we use this approximation technique to develop a 
new numerical frame approximation method. We demonstrate the effectiveness of our method 
with some numerical experiments. Concluding remarks are provided in Section [H 

2 Sampling with Frames 

Let us first review the definition of frame (see d] for more details). 

Definition 2.1. Let % he a separable Hilbert space and let {ipj}^-^ be a frame for % with bounds 



A and B. That is, we have for all f ^ Ti 



A\\ff<Y,\{f,i^j)\'<B\\ff, A,B>0. (2.1) 

i=i 

The frame operator S -.T-L ^T-L is defined as 

oo 

sf:=^{f,i^,)ij„ fen. 

Note that the frame operator S is bounded invertible by the frame condition, (|2.ip . Moreover, 
any function f £ Ti can be recovered from the sampUng data {(/, V'i)}?2=i by 

oo 

/ = E^-^'^i)^i' (2.2) 

where 

^PJ := S-%, j G N (2.3) 

is called the dual frame. 

Since S~^ is generally not available in closed form, it will be necessary to construct 5^ , a 
finite-dimensional subspace approximation corresponding to 0{N) finitely sampled frame coef- 
ficients or an 0{N) truncated series expansion. A general method of approximating the inverse 
frame operator S~^ was proposed in [2] and its convergence was discussed in [21 |3] (see also 
j4]). In what follows, we will call this technique the Casazza-Christensen method. Note that 
the convergence rate for this method has yet to be established. 

Our investigation seeks to establish the convergence rate of inverse frame operators under a 
certain set of constraints, which is essential in developing numerical frame approximations. To 
this end, we will use the concept of localized frames |13j : 

Definition 2.2. Let {ipj}^^ be a frame as defined in Definition \2.1\ We say that {■i/'j}?^! is 
localized with respect to the Riesz basis {(l)j}°?^i with decay s > if 

\{ijj,cPi)\<c{l + \j-l\)-' and\{^jji)\<cil + \j-l\)-', c>0,j,/GN. (2.4) 

The convergence rate of the numerical approximation to the inverse frame operator is directly 
related to the localization factor s. For example, when {(pj}^^ is an orthonormal basis, it was 
shown in [6l [H] that the finite section method approximates the inverse frame operator with a 
convergence rate dependent on localization rate s. The finite section method first establishes an 
bi-infinite linear system with the coefficients in the frame expansion and then approximates the 
solution by truncating the system: 

Algorithm 1. (Finite Section Method fB^ \14V Suppose {tl^j}'^-^ is a frame and we wish to 
approximate its inverse frame operator S~^ . That is, for a given function f, we wish to approx- 
imate g = S~^f. Suppose further that {(j)i}^i is an orthonormal basis. 

1. Define g = Yl^idi'Pi where gi = {g,(pi) are the basis coefficients. 



2. To determine g, it is equivalent to find {gi}. We consider Sg = f for g defined above. 

3. Taking the inner products of both sides with the orthonormal basis {(pj}^^, we have 

{Sg, 4>j) = {f, (Pj) = fj, 3 = 1, 2, ... 

4. The definition of g then yields Yl'ili9i{S4'i,4>j) = fj, where Scpi = Y,'^=i{(t>i,'^k)^k by 
Definition [2A[ 



5. We solve the system for gi . The maximum truncation values to ensure numerical stability 
and accuracy for the system are discussed in Remark \3.1[ 



In [U [13] it was shown that the convergence rate for Algorithm [T] is s — 1 for the locaUzation 
factor s given in (|2.4p . However, it is important to note that the method is appUcable only 
for frames localized to Riesz bases, and is not directly applicable to the more general case of 
intrinsically (self) localized frames: 

Definition 2.3. Let ip be a frame as defined in Definition \2.1\ We say that ip is intrinsically 
(self) localized if 

\{i^j,i^i)\<co{l + \j-l\)-\ co>0,j,ZGN, (2.5) 

with s > 1. 

Note that localization with respect to a Riesz basis (j2.4p implies the self-localization (j2.5p [9] . 
When the sampling frame {ipj}"^^ is intrinsically localized, we focus on the convergence rate of 
the Casazza-Christensen method proposed in [2]. In fact, in ^we show that this method yields 
better convergence than the finite section method given even less sampling data. However, as 
we also demonstrate in ^ the convergence rate for the Casazza-Christensen method is s — 1/2, 
very slow for small s and this rate is failing to hold for s < 1. This result can be quite restrictive 
in several applications. For example, new data collection techniques in magnetic resonance 
imaging (MRI) acquires a (finite) sampling of Fourier data on a spiral trajectory, [171 I18j . The 
corresponding Fourier frame [1] is not well localized. Motivated by a desire to improve the quality 
of images reconstructed from sampling with Fourier frames (also called non-uniform Fourier 
data in the medical imaging literature) , in Section d] we also investigate the approximation of 
the inverse frame operator when the sampling frame {■0^}^^ is not well-localized, that is, when 
(|2.5p holds for some s G (^,1]- Specifically, to improve the convergence behavior, we introduce 
a new frame with an admissible localization rate and make use of the projection onto the finite- 
dimensional subspace by a well-localized frame (rather than using the original sampling frame 
with the slow localization rate). We remark that while our method is useful for sampling frames 
with s < 1, it can also be used to improve the convergence rate for sampling frames with s > 1, 
but greater localization may be desired for the particular application. 

3 Constructing S~^ for Localized Frames 

Let us assume that the sampling frame {fpj}'j^i is intrinsically localized, that is, it satisfies (j2.5p 
for some s > 1. In this section we analyze the convergence properties and establish the rate of 
convergence for the Casazza-Christensen method for approximating the inverse frame operator 
under this localization assumption. The method is reviewed below. (For more details, see [21 Hj.) 



For any n G N, we let T-Ln '■= spanj-i/'j : 1 < J < ?^} be the finite-dimensional subspace of 
Ti for n G N. The finite subset {ipj}^^i is a frame for Tin (c.f. [1]) with the frame operator 
Sn'-T-L ^ T-Ln given by 

n 

Snf ■.= Y,{f,i^j)^j, fen. (3.1) 

Let Pn be the projection from Ti onto ^„ and let Vn be the restriction of PnSm on ?^„. That is, 

Vn '■= PnSm ]%,! ■ 

It was shown in [2] that for any n G N, there always exists a large enough m = m{n) G N 
depending on n such that Vn is invertible in T-Ln and for all / G 7^ 

K"'i^n/ ^ 5"V, as n ^ oo. (3.2) 

However, the rate of convergence for (j3.2p . which we will in sequel refer to as the Casazza- 
Christensen method, was not discussed. 

To establish the convergence properties of ()3.2p for intrinsically localized frames, ()2.5p . we 
observe that 

\\S-^f-V-^P^f\\<\\S-'f-PnS-^f\\^\PnS-^f-V-'PnSrnS-^f\\ + \\V-^PnSrnS-^f-V-^Pnf\\. 

(3.3) 
Since F„ ^PuSmd = 9 ^ov g e T-Ln, we have 

\\PnS-^f - V-'PnSm.S-'f\\ = \\V-' PnS„,iPnS-' f - S'^ f)\\ 

for the second term on the right hand side of (j3.3p . Also, PnS~^ f G Tin, V~^ PnSmPnS"^ f = 
PnS~^f implies that the third terms on the right hand side of (13. 3p can be rewritten as 

\\V-'PnSmS-^f - V-'Pnf\\ = \\V~'Pn{S^ " S)S-'f\\. 

It therefore follows that 

\\S-'f-V-'Pnf\\ 
< WS'^f - PnS-^fW + \\V-'PnSmiS-'f - PnS'' f)\\ + ||K"'^n(^ " Sm)S-' f\\. (3.4) 

We will estimate the three error terms on the right hand side of the above inequality separately. 
As it turns out, the self-localization property, (j2.5p . is fundamental in analyzing convergence. 

We begin with an estimate of the first term HS'"^/ — P„'S'~"^/||. To this end, we impose the 
following assumption on the decay of frame coefficients {f,ipj)- 

K/,V'i>l<cr^ c>0,jGN. (3.5) 



We also recall that the dual frame, (j2.3p has the same localization property as the original frame, 
[9]. Hence (12. 5p implies that there exists a positive constant c such that 

(vi,•,viz)|<c(l + |i-/r^ j,/GN. (3.6) 

To estimate \\S~^ f — PnS~^ f\\, we will first need the results of two lemmas. The first lemma 
is a result for the decay of the inner product of / with the dual frame {ipj}^i of {ipj}^i'- 



Lemma 3.1. // assumptions (j2.5p and (j3.5p hold, then there exists a positive constant c such 
that 



if, 4^, 



<cr', JGN, 



where ipj is given in 127L 

Proof. It follows from the dual frame property, [5] , that / = X]£i (/> 4'i)'4^i- By direct calculation, 
we have for any j G N that 



{f,^j) 



J2{f,^i){i'i,i'j) 



1=1 



By ()2.5p and (|3.5p . there exists a positive constant c such that for all j G N 

oo 



«=i 



The summation in the above inequality is bounded by a multiple of j '^ according to a lemma 
in [13], which finishes the proof. D 



The second lemma estimates ||/ — -Pn/ 1| when / satisfies (j3.5p and Pn is the projection from 

H to Un- 



Lemma 3.2. // assumptions (j2.5p and ()3.5p /loW, t/ien i/iere exists a positive constant c such 
that 

Proof. We define T„/ := Yll=iUi'4'j)'^j- Clearly T„/ G Hn- Since P„ is the projection from H 
to ?^.„, we have 

||/-^«/||<||/-T„/||. 

It suffices to show ||/ — Tnf\\ < cn~^'^~^''^' for some positive constant c, which we show by direct 
calculation. Since / = X^^i(/, V'i)''/'^ we have that 



ll/-7;/|p 






j,l=n+l 

It follows from Lemma 13.11 and (12. 5p that there exists a positive constant c such that 



||/-r„/f <c E j-n-^(i + \j-i\)-s. 

j,l=n+l 

Note that j and I are symmetric in the above inequality, and therefore 



||/-T„/f <2c Y. 

j=n+l 



r'Y.^-%i + \j-i\y 

1=3 



Since YZj ^"'(1 + li - ^1)"' < r' TZM + ^ - •?■)"' ^ ^J'"'' ^^ ^^^^ 



2c 



2c 1 



lu "•'II - 5_ 1 ^Z^ -^ - s_ 12s- 1 



j=n+l 



yielding the desired result. 



n 



We are now ready to estimate the first term US' ^f — PnS ^ f\\ in (j3.4p : 

Proposition 3.3. Assume (j2.5p and (j3.5p hold. Then there exists a positive constant c such 
that 

||5-V-^n5^Vll<cn-(^'i/2). (3.7) 



(/,^.-) 



< cj^"* for all j G N. 



Proof. By Lemma |3. 11 there exists a positive constant c such that 

Since {S~^f,ipj) = {f,S~^ipj) = {f^fpj), the function 5^-*^/ also satisfies (j3.5p . This combined 
with Lemma 13.21 implies the desired result. D 



We next estimate the second error term \\V~^ PnSm{S^^ f — PnS~^f)\\ in (13. 4p . Using (13. 7p 
and the fact that \\Pn\\ < 1 and \\Sm,\\ < II^H < B, we see that we only must estimate HV^^"*^!!. 
In fact, we shall show that we can choose m = m{n) such that ||1^"^|| is uniformly bounded for 
all n G N. To this end, we introduce the following constant 



Ar, 



(2S - l)Amin(M/n 



-n{m-n) ^^^^ ^\ 



(3.8) 



where ^n '■= [(V'i) V'«)]?/=i and Amin(^n) is its smallest eigenvalue. We assume here that the 
matrix ^n is invertible. Otherwise, we can use its invertible principle sub-matrix instead and 
the same analysis can be carried over. Note that m is always chosen to be greater than n. We 



first bound ||V^ ^|| for in. 



Lemma 3.4. Suppose (j2.5p holds. If Am,n < A, then {Pnipj}Y=i is a frame for Tin with frame 
bounds A — Am,n,B and frame operator Vn. Moreover, 

\\v-H< 



A- A, 



m,n 



Proof. We proceed by establishing the frame condition, (j2.ip . by direct calculation. For any 
g G T-Lm we have PnQ = g, which implies that 

m m m 

j=l j=l j=l 

To see the upper bound, we observe that 

m oo 

Y,\{9,4^j)\'<Y.\(9,i^j)\'<B\\gf. 
i=i i=i 

To estimate the lower bound, we first approximate X]?lm+i KSi-^nV'i)!^- Since g £ Tin, there 
exists some a G M" such that g = X]?=i o.jipj. It follows that 



j=m+l j=m+l 



^ai{ipl,ipj 



< \\af E 

j=m+l 



^{'^h^j 



1=1 



Applying (j2.5p to the last term in the above inequality yields 



oo n 



j=m+l j=m+l 1=1 



2s 



Since m > n, when j > m + 1, Yl?=ii^ + \J ~ ^\) ^^ < n(l + j ^ n) ^'*. It follows that 



2ii Ii2 

Cn a r 



j=m+l j=m+l 

Note that H^p = || l^?=i OjV'i IP = CL^^nO, > Amin(^n)||ct|p. Substituting this into the above 
inequality yields 

oo 
j=m+l 

Consequently, 

m oo oo 

j=l j=l j=m+l 

i.e., A — Am^n is the lower frame bound of the frame {Pnipj}JLi for Tin if ^m,n < A. 
To show Vn is the associated frame operator, we observe that for g £ Tin 

m m m 

'Y{9,Pn'>Pj)Pn'>Pj = 'Y(^'^9,'^j)Pn^j = E^^' '^i''^"^^' = PriSm9 = Kff- 

i=i i=i i=i 

The bound of ||V^^|| follows immediately. D 

We next give an estimate of \\V~^ PnSm{S~^ f — PnS~^f)\\ by choosing m such that ||V"„~^|| 
is uniformly bounded for all n G N. 



(3.9) 



Proposition 3.5. Suppose assumptions (|2.5p and (|3.5p hold. If we let 



m = n + 



2n 



1 

2s-l 



A{2s - l)A„,in(M/„) 
then ||V„~^|| < 2/ A and there exists a positive constant c such that 

\\V-'PnSm{S-'f - PnS-'m < ^"(^-1/2). 

Proof. The bound of ||^~^|| follows from substituting p.9p into (jS.Sp and applying Lemma[3 
Moreover, 

\\V~^PnSm{S~^f-PnS-'f)\\ < \\V-^\\\\Pn\\\\Sm\\\\S-' f - PnS'^ f\\ < ^WS'^ f - PnS'' f\\. 

This combined with Proposition 13.31 yields the desired result. D 

It remains to estimate the last term \\V~^Pn{S — 5'm,)«S'^-'^/|| in ()3.4p . We have the following 
result. 



Proposition 3.6. Suppose assumptions (j2.5p and (13. 5p hold. If we choose m as in ()3.9p . then 
there exists a positive constant c such that 

\\V-'Pn{S - Sm.)S-'f\\ < cn-(^-i/2). 



Proof. By Proposition 13.51 ||y„ ^|| < 2/ A. Since \\Pn\\ < 1, it suffices to show that 

\\{S-Sm)S~'f\\<cn-^'~'/-'^ (3.10) 

for some positive constant c. It follows from direct calculation that 

OO OO OO CX) 

j=m+l l=m+l j=m+l l=m+l 

By assumptions ()2.5p and ()3.5p . there exists a positive constant c such that 

OO OO 

\\{s-Sm)s-'ff<c Y E r'r%i + \j-i\r^. 

j=m+l l=m+l 

Note that we already show in Lemma 13.21 that the above summation term is bounded by 
__i___^-{2s-i) ^ which implies (fXTO]) . D 

We now summarize estimates of the three error terms in (j3.4p to obtain an estimate for 

Theorem 3.7. Suppose assumptions (j2.5p and (j3.5p hold. If we choose m as in (j3.9p . i/ien 
i/iere exists a positive constant c such that 

115-1/ _y^-ip„/||<cn-(^-i/2). 

Proof. It follows immediately from substituting estimates in Propositions 13. 3^ 13.51 and 13.61 into 
the error decomposition (j3.4p . D 



We close this section with two remarks: 

Remark 3.1. In JB^, the sampling frame is assumed to be localized with respect to an orthonormal 
basis and m is chosen to be 0{n~^^) to obtain the optimal convergence rate n~^^~^> . 

Remark 3.2. When {ipj}'^!^ is a Riesz basis, Amin(^n) is uniformly bounded below for all 
n € N. We see that m in ()3.9p is 0{n) and the optimal convergence rate is n~^^~^''^' . Hence 
when the sampling frame is localized, the Casazza-Christensen method yields better convergence 
properties than the finite section method, even when m, the number of given samples, is smaller. 

4 Constructing S^^ for General Frames 

We now consider the case when the sampling frame {V'j}?^! is not well-localized, that is, (|2.5p 
is satisfied only for some s € (2)1]- Theorem 13.71 demonstrates that the Casazza-Christensen 
method has low order convergence for s > 1 and the convergence rate does not hold for s < 1 
As discussed in Section [H effective numerical frame approximation techniques rely upon the 
accurate and efficient approximation of 5""^, and in a variety of applications, for frames that 
are not well-localized. Hence we introduce a new method of approximating the inverse frame 
operator S*"^ with better convergence properties. Our method is similar to (|3.2p . but uses 
a projection onto a different finite-dimensional subspace that is generated by a well-localized 
frame. To this end, we introduce the concept of an admissible frame {(j)j}'^i for % which is 
defined as: 



Definition 4.1. A frame {(j)j}?^i is admissible with respect to a frame {^jji^i ^/ 

1. It is intrinsically self localized 

\{^j,cl)i)\<co{l + \j-l\)-\ c>o,j,len, (4.1) 

with a localization rate t > 1, and 

2. We have 

\{ijjAi)\<ci{l + \j-l\r\ c>0,s>0,j,/GN. (4.2) 

We remark that for a frame to be admissible, we do not need s > 1, and in fact later we 
show that s > 2 ensures the convergence of the inverse frame operator. We also assume t > s. 
Otherwise, we can always take (j)j = ipj. 

We now introduce some notation. For n G N, let Gn '■= span {(f)j : I < j < n} and Qn be 
the projection from Ti to Qn- Note that QnSm is an operator from % to Qn-, and we denote its 
restriction on Qn by Wn '-= QnSm \g„- The following operator is used to approximate S~^: 

W-^Qnf -^ S-^f, as n ^ oo, (4.3) 

where we have assumed that Wn is an invertible operator on Qn- Later we discuss the conditions 
under which this assumption holds. The difference between (j4.3p and (j3.2p is that here we 
use Qn, the projection onto the finite-dimensional subspace Qn generated by the admissible 
frame {(j)j : 1 < j < n}, instead of Pn, the projection onto the finite-dimensional subspace Tin 
generated by the sampling frame {ipj : 1 < j < n}. This regularization allows for a numerically 
stable and convergent approximation of the inverse frame operator, even when the sampling is 
not done using well-localized frames. We will show that the convergence rate of approximating 
the inverse frame operator is now t — 1/2 instead of s — 1/2. Practically, when the sampling 
frame has a small localization rate s, we would like to find a frame with a greater localization 
rate t that is admissible with respect to the sampling frame. 

To estimate the approximation error ||5~^/ — W~^Qnf\\, we first give its symbolic decom- 
position. Clearly 

5~V - Wn'Qnf = S~Hf - Qnf) + S"\S - Wn)W-'Qnf, 

and by the frame condition, (]2.ip . we have H-S^^H < l/A. It therefore follows that 

\\S-'f - W-'QnfW <j\\f- QnfW + ^ l|(^ - Wn)Wn'Qnf\\ - (4.4) 

We first estimate ||/ — QnfW- 
Proposition 4.2. Assume that {(j)j}^^ is an admissible frame and that 

K/,0,)|<cr*, c>0,jGN. (4.5) 

Then there exists a positive constant c such that 

||/-gn/||<Cn-(*-l/2). 

Proof. It is an immediate consequence of Lemma 13. 2i D 

10 



We shall next estimate the second term 11(5* — VFn)W^rr"'^Qn/|| ^^ (|4.4p by first looking at 
ll^ — Wn\\- Note that the operator 5 — Wn is restricted to Qn- Let 0„ := [{4'jj4'i)]'^i=i arid 
Amm(^n) being its smallest eigenvalue. We here assume 0„ is invertible and Amin(^n) > 0. 
Otherwise, we can use its invertible principal submatrix instead. 

Lemma 4.3. Define 

j=rn+l 1=1 

and choose m > n. Then 

\\S — Wn\\ < Bm,n- 

Proof. For any g G Qn, since Qn is the projection onto Qn, we have QnQ = g- Recall that Wn is 
the restriction of QnSm on Qn- It follows that for any g £ Qn 

{Wng,g) = {QnSmg,g) = {Sm9,Qng) = {Smg,g), 

which implies that 

oo 

{{S-Wn)g,g) = {{S-Sn,)g,g)= ^ \{g,^j)\' ■ 

j=m+l 

Since g E Qn, we can write g = 'Yld=i '^i^i ^^r some a G M". It follows that 

oo n 2 oo n 

{{S-Wn)g,g)= Y. E^'^-^^'^i) ^ H^H' E E l^'^''^^')!'' 



j=m+l 



1=1 



j=m+l 1=1 



Note that WgW"^ = a <t>n(i > ^mm{^n)\\o-\\'^ ■ Substituting back into the above inequality yields 
{{S — Wn)g,g) < i3m_.„||(7|p, implying the desired result. D 

We next give an estimate of ||VF^^|| also depending on Bm^n- 

Lemma 4.4. If Bm,n < ^, then {Qn'^j}JLi ^^ ^ frame for Qn with frame bounds A — Bm^nj B 
and the frame operator Wn- Moreover, 

\\w~H < ^ 



71 



A-Bn 



Proof. We will check the frame condition (j2.ip by direct calculation. For any g £ Qn, ^^ have 
Qng = g, which implies that 

m m m 

Y,\{g,Qni^j)? = Y.\{Qng,i'j)? = Y.\{g,i^,)?- 
j=i j=i j=i 

To see the upper bound, observe that 

m oo 

Y\{g,i^j)\'<Y.\{g,i^,)\'<B\\g\\'. 
i=i i=i 
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To show the lower bound, by Lemma HT3l we have X^^l^+i Kfi',''/'i)P 1^ ^m,n|blP- It fohows 
that 

m oo oo 

j=l j=l j=m+l 

The above two inequahties imphes that {Qnip^y^i is a frame for Qn with frame bounds A—Bm,m 
B if S^,„ < A. 

To show Wn is the associated frame operator, observe that for any g G Qn, 

m m m 

'^{9,QnTpj)Qni'j = '^{Qng,Tpj)Qni'j = ^{9,Tpj)Qni'j = QnSmQ = WnQ- 
j=l j=l j=l 

The bound of ||VF~'^|| is an immediate result from the lower frame bound of Wn- D 

Lemmas 14.31 and 14.41 yield corresponding estimates for ||5 — Wn\\ and ||VF~^|| dependent on 
the constant Bm,n- We now estimate Bm,n under the admissibility assumption. 

Lemma 4.5. Let {(l>i}^i be admissible with respect to the frame {^l^j}^l where (|4.2p holds with 
s > 1/2. Then 

'"■" - 2s - 1 A^i„(cl>„) ^ ^ 

Proof. By ()4.2p . we have 

oo n oo n. 

E EK'^''V'.>i'< E E-?(i + i^'-^r'^- 

j=m+l 1=1 j=m+l 1=1 

It follows from m > n and s > 1/2 that 

oo n oo 2 

E ^\{^l,i^j)\''<cf E n(l+j-n)-2^<^-^n(m-n)-(2-i). 

j=m+l 1=1 j=m+l 

Substituting into (j4.6p yields the desired result. D 

We now present an estimate of IKS' — Wn)W~^Qnf\\ by combining the above three lemmas: 



Proposition 4.6. Suppose {(j)j}^^ is admissible with respect to the frame {V'j}?^i ti^^ that 
(|43]) holds. If 

2c? 1 2s-l t+1/2 

m = n + a —- —\ -— - n 2»-i , a > 0, (4.7) 

then Bm,n < a~^^'^~^^n~^^~^'^' . Moreover, there exists a positive constant c such that for all 

\\{S-Wn)W-'QrJ\\<C7l~('~^/'\ 

Proof. The bound of Bm,n follows from substituting (j4.7p into the estimate of Bm,n in Lemma 
31 It follows from Lemmas 14.31 and 14.41 that 



\\{S-Wn)W-'Qnf\\ < \\S-Wn\\\\W-'\\\\Qn\\\\f\\ < ^" 



This combined with the bound of Bm,n implies the desired result. D 
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We remark that in the above proposition, m is chosen to obtain the optimal convergence 
rate n~(*~^/2)_ 

The main theorem regarding the convergence rate for our new method of approximating the 
inverse frame operator S~^, (j4.3p . as a summarized result of the two estimates in Propositions 
2] and 14.61 can now be given: 



Theorem 4.7. Let {(pj}'^^ be an admissible frame with respect to the frame {'ipj}'^i and assume 
that ()4.5p holds. If m is chosen as in ()4.7p . then there exists a positive constant c such that 



\S-'f-W-'Qnf\\<cn 



-(i-l/2) 



Proof The desired result follows directly from substituting estimates in Propositions 14.21 and 
2] into the error decomposition in (j4.4p . D 



5 Numerical Frame Approximation 

In this section we employ the approximation of inverse frame operator S^^ presented in (|4.3p 
to obtain an efficient reconstruction of an unknown function f in Ti from the sampling data 
{(/, '0j)}7Li- Recall that / can be represented by (|2.2p . However, we typically only have access 
to finite sampling data {(/, '0j)}7Li; and moreover, we do not have a closed form for S~^. Hence 
we will utilize the approximation W~^Qn in (j4.3p and reconstruct / as 

m 
fn,m := J](/, i^j)W~'Qni^j = W^^QnSmf- (5.1) 

J=l 

We remark that since Wn is the restriction of QnSm on Qn, the restriction of Wn^QnSm on 
Qn is the same as the identity operator. Therefore ()5.ip is exact for / in On- Furthermore, 
if the finite-dimensional subspace Qn is "close" to the underlying space 7i, the reconstructed 
function should also be "close" to the unknown function /. Recall that Gn is generated by the 
admissible frame {(Aj}?=ii ensuring good approximation properties, as determined by Theorem 
14.71 for suitable sampling space size mo 

To estimate the approximation error ||/ — fn,m\\, we first note that 

f-fn,m = f- Qnf + Qnf " W-^QnSrrJ- 

Since Qnf G Gn, we have Qnf = W~^QnSmQnf- Hence 

11/ - fn,m]\ < 11/ - QnfW + ||^^„-'Qn.S,n|| ||/ " Qnfl 

Since ||<3n|| ^ 1 and \\Sm\\ < \\S\\ < B hy the frame condition (j2.ip . we have 

11/ - fn,m]\ < 11/ - QnfW + B\\W-'\\\\f - Q„/||. (5.2) 

Note that an estimate of ||/ — QnfW was provided in Proposition 14.21 It remains to estimate 
||iy~^||. In fact, Theorem 15.11 shows that we can choose m depending on n such that HW^""^!! is 
uniformly bounded for all n. By Lemma 14.41 it suffices to choose m such that Am,n < A/2 in 
()3.8p for all n G N, where A is the upper frame bound in ()2.ip . 



^Clearly the convergence of (|5.ip will depend on the smoothness properties of / with respect to the admissible 
frame (p. In the case where / is only piecewise smooth, we note that post-processing can be applied using the 
spectral reprojection method, |10) . 
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Theorem 5.1. Suppose the assumption (j4.2p holds with s > 2- If we let 

2c{n 



m 



n + 



^(2S - l)Amm(^n,) 



1 

23-1 



(5.3) 



then \\Wn ^11 < ;! for all n G N. Furthermore, if assumptions (|4.ip and (|4.5p also hold, then 
there exists a positive constant c such that 



Wf-fn, 



< cn 



-(t-l/2) 



Proof. The bound of \\W^ ^\\ follows immediately from Lemma 14.41 and substituting (j5.3p into 
dMl). 

The estimate of \\f — fn,m\\ follows from substituting the bound of ||VF~^|| and the estimate 
of 11/ — QnfW ill Proposition 14.21 into the error decomposition (j5.2p . D 

We make the following remarks about the choice of m: 

Remark 5.1. Notice that m in (jS.Sp is much smaller than m in (|4.7p . This is because we 
only need Bm,n ^ ^/2 to obtain the optimal order for reconstructing the unknown function f , 
while Bm,n = 0{n~^^~^''^') is required to obtain optimal order for approximating the inverse 
frame operator. From a practical point of view, it is only necessary to satisfy (5.3\) for function 
reconstruction. 

Remark 5.2. When {(/)j}^;^ is a Riesz basis, the minimal eigenvalue Amm(*t'n) of<i>n is bounded 
below for all n G N. To ensure ||W^^|| is uniformly bounded in that case, for s G (1/2, 1) we 
have m = 0{n^^-^ ), and for s > 1 we have m = 0{n). 

Finally, Proposition 15.21 shows that fn.m is the least squares solution for {{f,ipj)}'T^i in Qn- 

Proposition 5.2. Suppose {ipj}^^^ is admissible with s > ^ and m is chosen as in (|5.3p . Then 



fn,m = argmin ^ | {g, ipj) - (/, tpj 



9<^g 



j=i 



Proof. We first reformulate the least squares problem in terms of the coefficients. For any 
g = Yl]=i 0'j4>j ^Gn^^^e have 






{f,^i)\' 



Qa-f 



(5.4) 



where Q := [{iPj,M';^Cv « ■= K-]i=i and f = [{f,i',)]]l^. 

To show that fn,m is the least squares solution of (j5.4p , we note that (|4.2p and choosing m to 

satisfy (j5.3p ensure that Wn is invertible and fn,m is well defined. Thus for fn,m = S7=i '^j4>j ^ 

Qn, it suffices to show 

^ 2 
c = argmin Qa — / . (5-5) 

a6lR„ 
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To demonstrate (j5.5p . first observe from (jS.ip that Wnfn,m = QnSmf ■ Since W„ is tlie restriction 
of QnSm on ^„, we have QnSmfn,m = QnSmf- Furthermore, since Qn is the projection onto 
Gn, we have 

{Smfn,m, 4>j) = {Smf, 0j), 1 < J < n. 

A direct calculation from the above equalities yields that 

which are the normal equations for (15. Sp . D 



5.1 Computational Algorithms for /„m 

We now discuss some algorithms for computing fn,m '■= W~^QnSmf- Calculating Smf from the 
sampling data {(/, V'j)}j=i is straightforward using (j3.ip . To calculate QnSmf i we introduce 
the operator 

Un{g) ■■= ^{g, 4>j)(t>j, 9 G Qn- 

i=i 

Note from (|3.ip that [/„, is the frame operator for the finite frame {4>j}'^^i in t/„ and the projection 
QnQ for any g £ Qn can therefore be computed by 

^"5' = '^'\9Aj)Un^(l)j. 
i=i 

Typically the inverse frame operator C/^^ is determined by solving the finite system C/„g = 
for g. It follows that 

n n ni 

Wnfn,m = QnSmf = ^^(^m/, </',)^n V, = ^ E^^' V'i) (V';, <^,>C^„- Vj- (5-6) 

Hence to obtain fn,nn we need to apply W~^ to (j5.6p . Recall that Wn is the restriction of QnSm 
on ^„. When m is chosen as in (j5.3p . the operator M^n has lower bound A/ 2 and upper bound 
B. To compute W^^, we apply the iterative algorithm given in [7]: 

f(0) = 

J n,m " 

/SI = /&'^ + ^4/^^n(/n,n^-/&^)), i G N. (5.7) 

To determine the convergence of ()5.7p . observe that 



m) 



and since 



-^ A/2+B ^" 



— y!i/2+B ' ^* follows that 



\\fn,m Jn,m,\\ — I A /n , n j \\jn,m\\- {^■°) 
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Unfortunately (j5.7p requires explicit estimates of the frame bounds A and B that are un- 
known or impractical to obtain in most cases. Moreover, the convergence of this iteration 
method is quite slow if B/A is large. Hence we employ the conjugate gradient acceleration 
method introduced in [12] to compute /„ m- 



Algorithm 2. (Conjugate gradient acceleration method for computing fn,m) 

1. Initialization: f^^L = 0, vq = po = Wnfn,m, P^i = 

2. repeat (j > Oj 

5. a--^^^^^ 



I fO'+i) _ f(i) I ^.„. 

4- jn,m — Jn,m T^ ^^jfj 

5. rj+i = rj - OjWnPj 

6. pj+i = WnPj - ^^{p^,w^p/)'^ Pj - %"^':w^pllf) Pj-^> ^^^^ ^^e last term set to zero when 
Pj~i = 0. 

7. until the stopping criterion is met 

The following convergence result for Algorithm [2] is shown in [12] : 
Proposition 5.3. Let fn,m. be computed by Algorithmic There holds that for all j € N 

II f _ f{i) IK i±^^^ II f II 

\\Jn,m Jn,m\\ — i i , Oi H-'"''^!! ' 

where a = UfB - ^/Af2\ / (JB + ^/aJ2\ . 

We remark that Algorithm [2] does not require explicit estimates of the frame bounds. It also 
improves the convergence rate of (j5.8p . 

5.2 Sampling with Fourier Frames 

Motivated by the data acquisition techniques used in magnetic resonance imaging (MRI) , [H [ini 
I19| . in this section we consider the special case of sampling with Fourier frames. Specifically, we 
defined = L'^[-l,l] and let 

ijj{x) = e-'^^^^, A,-=j + 0, jeZ, (5.9) 

where each ^j is a random variable uniformly distributed in [—1/4, 1/4]. The sampling scheme 
(|5.9p describes the situation where Fourier data is collected mechanically, and the samples are 
"jittered" from the presumably uniform distribution. By Kadec's 1/4-Theorem [1], {jpj}Jl-^ is a 
frame in T-L. For ease of presentation, below we use Z as the index set, and note that the results 
are similarly obtained to those from previous sections using N. 

Suppose we are given the first 2m + 1 frame coefficients {{f,'4'j)}7L-m ^^^ ^'^ unknown 
function f £ Ti. We will reconstruct the function / with the Fourier basis. That is, we let 

(Pj = e"*^^'^, j e Z. (5.10) 

The Fourier basis (j5.10p is an admissible frame with respect to the Fourier frame given by (j5.9p : 
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Lemma 5.4. Suppose ipj and (j)j, j G Z are given in (j5.9p and (|5.10p respectively. Then {(j)j}j^z 
is admissible for all t > and (I4.2p holds with ci = S/vr and s = 1. 

Proof. Since {<Pj}jez is orthonormal, (|4.ip holds for all t > 0. To check (|4.2p . we have for 

j,leZ: 

2 



KV'„'A;)I 



1 



■ sin (7r(Aj — /)) 



7r(A, - 

When j = I, \X,-l\ = le^l < 1/4 and K^„</.,)| < 2. Whenj ^ /, |A,-/| = |j+e,-^l > i(l+|j-^l) 
and \{ipj,(l)i)\ < ||Aj - /|~^ < f (1 + \j - l\)~^. It follows that (jM]) holds with ci = S/vr and 
s = 1. D 

Note that when {4>j}jez is the Fourier basis, the matrix <i>n is the identity matrix. The m 
in (j5.3p reduces to ©(n). We have the following result. 

Proposition 5.5. Suppose {^j}jgz and {(j)j}j^z o,i"e given in (j5.9p and (jS.lOp respectively. If 
(123]) /loWs and m = ^^^^^P^n, then 

||/-/n,^||<cn-(*-V2). 

Proof. It is an immediate consequence of Lemma 15.41 and Theorem 15.11 D 

We now present some numerical experiments to illustrate our results. 

Example 5.1. 

fix) = e--' 

For each 2n + 1 frame elements used to reconstruct the function in (j5.ip . we set m = 1.4n, 
where 2m + 1 is the number of given Fourier frame coefficients with the Fourier frame defined 
in ()5.9p . We compare the numerical results of our method (|5.ip with the Casazza-Christensen 
method. In both cases we employ the conjugate gradient acceleration method in Algorithm [2] to 
construct the inverse frame operator with stopping criterion of relative error less than l.E-5. We 
also compare our results to the standard Fourier reconstruction, or \j = j in (j5.9p and m = n. 
Note that in this case the frame operator is self-dual with S = S~^ = I. Table [1] compares 
the L2 error, computational cost, and the condition number of these schemes for various n, 
and demonstrates that our method (15. ip converges more quickly with fewer iterations and has 
better conditioning than the Casazza-Christensen method. As is also evident from Table [H 
our new method provides the same rate of convergence as the standard Fourier partial sum. 
In fact, as the smoothness of the target function increases, it is apparent that our numerical 
frame approximation yields the same exponential convergence properties as the harmonic Fourier 
approximation does. Figure [1] compares the function reconstructions and corresponding point- 
wise errors. 

Example 5.2. 

f{x) = cos (7r2;)(sin (x) + 1) 

Here we assume we are given fewer frame coefficients, m = 1.2n. Table [2] compares the 
L2 error, computational cost, and the condition number of our method (|5.ip to the Casazza- 
Christensen method, and also displays the standard Fourier approximation error. Figure [2] 
displays the reconstructions and point-wise errors for each method. 

17 







error 




iterations 


condition number 


n 


(a) 


(b) 


(c) 


(a) 


(b) 


(a) 


(b) 


16 


4.6E-2 


1.4E-3 


1.4E-3 


20 


12 


23.4 


4.6 


32 


2.1E-2 


6.0E-4 


6.0E-4 


24 


12 


23.8 


4.2 


64 


1.2E-2 


2.6E-4 


2.6E-4 


25 


12 


23.9 


4.5 


128 


9.2E-3 


1.3E-4 


1.3E-4 


28 


13 


28.8 


5.4 


256 


7.6E-3 


6.0E-5 


6.0E-5 


29 


13 


33.4 


5.8 



Table 1: Results using (a) the Casazza-Christensen method, (b) our new method (|5.ip with m = 1.4n and (c) the 
standard Fourier reconstruction method for Example 15.11 . 
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Figure 1; (a) Reconstruction for Example 15.11 (b) Point- wise Zoijio error of the reconstruction by the Casazza- 
Christensen method; (c) Point- wise logio error of the reconstruction by our method (|5.1|) . 







error 




iterations 


condition number 


n 


(a) 


(b) 


(c) 


(a) 


(b) 


(a) 


(b) 


16 


2.6E-2 


1.8E-3 


1.8E-3 


21 


12 


19.9 


4.5 


32 


l.OE-2 


7.4E-4 


7.3E-4 


22 


12 


20.9 


4.5 


64 


2.2E-2 


3.2E-4 


3.2E-4 


27 


13 


28.3 


5.4 


128 


1.8E-3 


1.6E-4 


1.6E-4 


30 


13 


30.5 


5.5 


256 


4.7E-3 


7.3E-5 


7.3E-5 


30 


13 


32.8 


5.7 



Table 2: Comparison of (a) the Casazza-Christensen method, (b) our new method (|5.1[) . and (c) the standard 
Fourier reconstruction method for Example 15.21 



18 



-test function 
- our method 
C-C method 




-1 



-0.5 





(a) 



0.5 





(c) 

Figure 2: (a) Reconstruction of /(s) = cos^(7ra;)(sin^(a;) + l); (b) Point-wise logio error for the Casazza-Christensen 
method; (c) Point-wise logio error for (|5.ip : 
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Once again, as illustrated in Table [2] and Figure [21 we see that our method (jS.ip converges 
even when less sampling data {m = 1.2n) is used, and its numerical properties are better than 
for the Casazza-Christensen method. It appears as though since the Fourier frame is not well 
localized, the convergence rate analysis in Section [3] does not apply. 



Example 5.3. 



2\3 



f{x) = {l-x') 

Example 15.31 provides a smoother test case. Table [3] and Figure [3] compare the results using 
our method with those from the Casazza-Christensen method with m = lAn. Also, once again 
we see that the convergence rate for our method is nearly identical to that of the standard 
Fourier approximation. 







error 




iterations 


condition number 


n 


(a) 


(b) 


(c) 


(a) 


(b) 


(a) 


(b) 


16 


3.3E-2 


2.1E-5 


2.1E-5 


30 


18 


20.8 


4.5 


32 


9.9E-3 


2.0E-6 


2.0E-6 


35 


18 


24.4 


4.9 


64 


7.0E-4 


2.0E-7 


1.9E-7 


40 


18 


28.3 


5.3 


128 


3.9E-3 


2.1E-8 


2.0E-8 


41 


19 


30.1 


5.5 


256 


1.7E-2 


2.8E-9 


2.1E-9 


46 


21 


30.3 


6.1 



Table 3: Comparison of (a) the Casazza-Christensen method, (b) our new method (|5.1[l . and (c) the standard 
Fourier reconstruction method for Example 15.31 



Remark 5.3. It is evident that our numerical frame approximation Ii5.1\) depends upon the 
convergence properties of the admissible frame. In particular, if a Fourier basis is used, the 
reconstruction depends upon the smoothness and periodicity of the target function f. Hence 
when the target function is not smooth or not periodic, the method will suffer from the Gihhs 
phenomenon. One possible way to overcome this difficulty is to employ a post-processing tech- 
nique, such as filtering or spectral reprojection, on the reconstruction. In fact, it was shown 
in \10^ that it is possible to obtain exponential convergence when recovering piecewise smooth 
functions using spectral reprojection for frames. On the other hand, we may consider the projec- 
tion on some other well-localized frames such as polynomial frames instead of the Fourier basis 
used in approximation of the inverse frame operator. In other words, we should identify some 
well-localized frames that can fit in our setting and represent the unknown target function well 
without the Gibbs phenomenon. We shall leave these ideas to future investigations. 

6 Concluding Remarks 

In this investigation we constructed an approximation to the inverse frame operator. We then 
used this approximation to develop a new reconstruction method when given a finite number 
of frame coefficients. Our method is especially useful when the original frame coefficients are 
not well localized, that is, the frame has localization rate no more than 1. It is important to 
point out that the number of samples required for our method is typically of the same order 
as the number of terms in the reconstruction. The method can also be used to improve the 
convergence rate in the case when the frame has localization rate greater than 1. This is done 
through the introduction of admissible frames and the projection from the space spanned by the 
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-test function 

• our method 

• C-C method 




(a) 





(c) 

Figure 3: (a) Reconstruction of f{x) = (1 — x'^)^; (b) Point-wise logio error for the Casazza-Christensen method; 
(c) Point- wise logio error for (|5.1|l : 

original frame elements onto the finite-dimensional subspace spanned by the admissible frame. 
Our numerical results demonstrate that our new method provides faster convergence with fewer 
iterations than the Casazza Christensen method, and moreover, the decay rate of the projected 
coefficients is the same as if the samples were originally given on the admissible frame. Because 
of this it appears that in most cases a Riesz basis should be used as the admissible frame, 
since (1) it means that fewer samples m are originally required and (2) it generates a more 
robust approximation of the inverse frame operator. However, when a sparse representation is 
necessary, a redundant frame may be more suitable. 

As discussed in Section [5l in the case of using the Fourier basis as the admissible frame, the 
reconstruction will yield the Gibbs phenomenon for piecewise smooth functions. The spectral 
reprojection method [10] may be used to post-process the reconstruction and recover exponential 
convergence. On the other hand, it may prove to be more useful to use an admissible frame that 
makes different smoothness assumptions on the target function. 

Finally, in this study we considered only the noise- free case. When the sampling data is noisy, 
regularization techniques can be incorporated into our approach to obtain a robust and efficient 
approximation of both the inverse frame operator and the target function. This idea, along with 
the others discussed in the preceding paragraphs, will be addressed in future investigations. 
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